Image processing and display method, augmented reality device, image processing device, and display system

ABSTRACT

An image processing and displaying method, AR device, image processing device, and a display system are provided. The image processing and displaying method is applied to a display system, wherein the display system includes an Augmented Reality (AR) device and an image processing device, and the image processing and displaying method includes: acquiring, by the AR device, a real-time image of a current view field of a user wearing the AR device in a real environment; sending, by the AR device, the real-time image to the image processing device; receiving, by the AR device, a display direction, an imaging distance, and a target image sent by the image processing device, and displaying, by the AR device, the target image in a virtual display area according to the display direction and the imaging distance.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Patent Application No.202011475969.6 filed in China on Dec. 14, 2020, the entire contents ofwhich are hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to the field of display technology, andparticularly, the present disclosure relates to an image processing anddisplaying method, an Augmented Reality (AR) device, image processingdevice, and a display system.

BACKGROUND

AR is a technology to calculate the position and angle of camera imagein real time, and add corresponding images, videos and three-Dimensional(3D) models. An AR head-display device is a wearable device whichrealizes an AR technology and can be worn on a human head for display.Virtual information can be overlapped into a real world through acomputer technology, so that a real environment and virtual objects canbe overlapped on a same image in real time, so as to realize the mutualsupplement of the two kinds of information, and display an image beforethe user's eyes through a helmet, glasses, and other devices, so as toenhance the sense of reality of a user.

However, the AR glasses of the related art usually have a problem thatthe display of the target image is not clear.

SUMMARY

Embodiments of the present disclosure provide an image processing anddisplaying method, AR device, image processing device, and a displaysystem.

In a first aspect, the present disclosure provides an image processingand displaying method applied to a display system, wherein the displaysystem includes an Augmented Reality (AR) device and an image processingdevice, and the image processing and displaying method includes:

acquiring, by the AR device, a real-time image of a current view fieldof a user wearing the AR device in a real environment;

sending, by the AR device, the real-time image to the image processingdevice;

receiving, by the AR device, a display direction, an imaging distance,and a target image sent by the image processing device, and displaying,by the AR device, the target image in a virtual display area accordingto the display direction and the imaging distance.

In a possible implementation, the image processing and displaying methodfurther includes: before acquiring, by the AR device, the real-timeimage of the current view field of the user wearing the AR device in thereal environment,

receiving a display mode selection instruction;

determining a display mode according to the display mode selectioninstruction, wherein the display mode includes a projection mode and aspatial mode; in the display mode, the display direction correspondinglychanges as the current view field changes; in the spatial mode, thedisplay direction is a preset fixed direction; and

sending the display mode to the image processing device.

In a possible implementation, the image processing and displaying methodfurther includes: before acquiring, by the AR device, the real-timeimage of the current view field of the user wearing the AR device in thereal environment,

scanning an environmental scene within a preset range in the realenvironment to form an environmental scene image;

sending the environmental scene image to the image processing device.

In a possible implementation, the image processing and displaying methodfurther includes:

detecting a light change of the environmental scene in the realenvironment;

adjusting a transmittance of a lens of the AR device according to thelight change.

In a possible implementation, the image processing and displaying methodfurther includes: after sending, by the AR device, the real-time imageto the image processing device,

receiving, by the image processing device, the real-time image sent bythe AR device;

adjusting, by the image processing device, an image to be displayedbased on the real-time image, and taking, by the image processingdevice, the adjusted image to be displayed as the target image;

determining, by the image processing device, the display direction andthe imaging distance according to the real-time image and a pre-storedenvironmental scene image; and

sending the target image, the display direction, and the imagingdistance to the AR device,

wherein the environmental scene image includes an area corresponding toa virtual display area configured for displaying the target image.

In a possible implementation, the adjusting, by the image processingdevice, the image to be displayed based on the real-time image,includes:

performing color analysis on the real-time image to obtain a color ofthe real-time image;

determining whether a display difference between a color of a text inthe image to be displayed and the color of the real-time image is lessthan a preset value;

when the display difference between the color of the text in the imageto be displayed and the color of the real-time image is less than thepreset value, adjusting the color of the text in the image to bedisplayed, to enable the display difference between the color of thetext in the image to be displayed and the color of the real-time imageto be not less than the preset value.

In a possible implementation, the adjusting, by the image processingdevice, the image to be displayed based on the real-time image,includes:

detecting whether there is an image of a person in the real-time image;

when there is the image of the person in the real-time image, adjustinga display style of the text in the image to be displayed, to enable thetext in the image to be displayed to be separated from the image of theperson, wherein the display style includes at least one of: a displayarea, a display size, and a display quantity.

In a possible implementation, the adjusting, by the image processingdevice, the image to be displayed based on the real-time image,includes:

detecting whether there is a fixed blocking object image in thereal-time image; the fixed blocking object image corresponds to a fixedblocking object in an environmental scene in the real environment;

when there is the fixed blocking object image in the real-time image,adjusting the display style of the text in the image to be displayed, toenable the text in the image to be displayed to be separated from thefixed blocking object image; the display style includes at least one of:the display area, the display size, and the display quantity; and/or,

determining the display direction and the imaging distance according tothe real-time image and the pre-stored environmental scene image,includes:

detecting whether there is a fixed blocking object image in thereal-time image; the fixed blocking object image corresponds to a fixedblocking object in an environmental scene in the real environment;

when there is the fixed blocking object image in the real-time image,adjusting the imaging distance to be modified of the text in the imageto be displayed, and taking the adjusted imaging distance to be modifiedas the imaging distance, to enable the text in the image to be displayedto be separated from the fixed blocking object image.

In a possible implementation, the image processing and displaying methodfurther includes: before receiving, by the image processing device, thereal-time image sent by the AR device,

receiving the display mode sent by the AR device;

the determining the display direction and the imaging distance accordingto the real-time image and the pre-stored environmental scene imageincludes:

when determining that the display mode is the projection mode,determining a direction range of the current visual field of the userwearing the AR device according to the real-time image and thepre-stored environmental scene image, and taking a preset direction inthe direction range of the current visual field as the displaydirection; and

when determining that the display mode is the spatial mode, taking thepreset fixed direction corresponding to the pre-stored environmentalscene image as the display direction.

In a possible implementation, the AR device is AR glasses or an ARhelmet.

In a second aspect, embodiments of the present disclosure provide the ARdevice, which includes:

an acquisition circuit, configured for acquiring a real-time image of acurrent view field of a user wearing the AR device in a realenvironment;

a first sending circuit, configured for sending the real-time image tothe image processing device, to enable the image processing device toadjust the image to be displayed based on the real-time image, take theadjusted image to be displayed as the target image, determine a displaydirection and an imaging distance according to the real-time image andthe environmental scene image pre-stored in the image processing device,and send the target image, the display direction and the imagingdistance to the AR device, wherein the environmental scene imageincludes an area corresponding to a virtual display area configured fordisplaying the target image; and

a display circuit, configured for receiving the target image, thedisplay direction, and the imaging distance sent by the image processingdevice, and displaying the target image in the virtual display areaaccording to the display direction and the imaging distance.

In a possible implementation, the acquisition circuit is a cameracircuit.

In a possible implementation, the AR device further includes:

a light sensing device, communicatively connected to the display circuitand configured for detecting a light change of the environmental scenein the real environment and sending the light change to the displaycircuit,

wherein the display circuit is further configured for adjusting a lenstransmittance of the AR device based on the light change.

In a third aspect, embodiments of the present disclosure provide animage processing device which includes:

a receiving circuit, configured for receiving a real-time image of acurrent view field of a user wearing an AR device in a real environmentsent by the AR device;

a first processing circuit, configured for adjusting an image to bedisplayed based on the real-time image, and taking the adjusted image tobe displayed as a target image;

a second processing circuit, configured for determining a displaydirection and an imaging distance according to the real-time image andan environmental scene image pre-stored in the image processing device;and

a second sending circuit, configured for sending the target image, thedisplay direction, and the imaging distance to the AR device.

In a fourth aspect, embodiments of the present disclosure provide adisplay system which includes:

a processor,

a memory electrically connected to a processor;

at least one program stored in a memory and configured to be executed bythe processor, wherein the at least one program is configured forimplementing the image processing and displaying method as described inthe first aspect.

In a fifth aspect, embodiment of the present disclosure provides adisplay system including the AR device according to the second aspectand an image processing device;

the image processing device is configured for adjusting an image to bedisplayed based on the real-time image, taking the adjusted image to bedisplayed as a target image, determining a display direction and animaging distance according to the real-time image and an environmentalscene image pre-stored in the image processing device, and sending thetarget image, the display direction, and the imaging distance to the ARdevice, wherein the environmental scene image includes an areacorresponding to a virtual display area for displaying the target image.

In a sixth aspect, embodiments of the present disclosure provide acomputer-readable storage medium which is configured for storingcomputer instructions that, when executed on a computer, implement theimage processing and displaying method of the first aspect.

Additional aspects and advantages of the disclosure will be partiallypresented in the following descriptions and partially become apparentfrom the following descriptions or get understood by implementing thedisclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing and/or additional aspects and advantages of the presentdisclosure will become apparent and readily appreciated from thefollowing description of embodiments in conjunction with theaccompanying drawings, in which:

FIG. 1 is a schematic structural diagram of a display system of ARglasses provided by an embodiment of the present disclosure;

FIG. 2 is a principle schematic diagram of the AR glasses for displayingin a virtual display area provided by an embodiment of the presentdisclosure;

FIG. 3 is a schematic structural diagram of the AR glasses provided byan embodiment of the present disclosure;

FIG. 4 is a schematic flow diagram of a display method of the AR glassesprovided by an embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of an image processing methodprovided by an embodiment of the present disclosure;

FIG. 6 is a schematic flow diagram of another image processing methodprovided by an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a display device of the ARglasses provided by an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of image processing deviceprovided by an embodiment of the present disclosure; and

FIG. 9 is a schematic structural diagram of another image processingdevice provided in an embodiment of the present disclosure.

DETAILED DESCRIPTION

Description will now be made in detail to the present disclosure,examples of the embodiments of the present disclosure are illustrated inthe accompanying drawings, wherein the same or similar referencenumerals refer to the same or similar parts or parts having the same orsimilar functions throughout. Furthermore, if a detailed description ofknown technology is not necessary for illustrating the features of thepresent disclosure, it is omitted. The embodiments described below withreference to the drawings are exemplary and intended to explain thedisclosure and should not be explained as limits to the disclosure.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by thoseof ordinary skill in the art to which the present disclosure belongs. Itshould be further understood that terms, such as those defined incommonly used dictionaries, should be interpreted as having a meaningthat is consistent with their meaning in the context of the related artand will not be interpreted in an idealized or overly formal senseunless expressly so defined herein.

As used herein, the singular forms “a”, “an”, “the” and “this” mayinclude the plural forms as well, unless expressly stated otherwise. Itshould be further understood that the terms “includes” and/or“including” when used in this specification, specify the presence of thefeatures, integers, steps, operations, elements, and/or components, butdo not preclude the presence or addition of one or more other features,integers, steps, operations, elements, components, and/or groupsthereof. It should be understood that when an element is referred to asbeing “connected” or “coupled” to another element, it can be directlyconnected or coupled to the other element, or intervening elements mayalso be present. Furthermore, “connected” or “coupled” as used hereincan include wirelessly connected or wirelessly coupled. As used herein,the term “and/or” includes all or any one of one or more associatedlisted items and all combinations thereof.

Hereinafter, the technical solutions of the present disclosure and howthe technical solutions of the present disclosure solve the abovetechnical problems will be described in detail with specificembodiments.

The embodiments of the present disclosure provide a display system 10 ofAR glasses 100, referring to FIG. 1 , which includes: AR glasses 100 andan image processing device 200 which are communicatively connected; theAR glasses 100 are configured for acquiring a real-time image of acurrent visual field range of a user wearing the AR glasses 100 in areal environment, sending the real-time image to image processing device200, receiving a target image, a display direction, and an imagingdistance sent by the image processing device 200, and displaying thetarget image in a virtual display area 300 according to the displaydirection and the imaging distance; the image processing device 200 isconfigured for adjusting an image to be displayed based on the real-timeimage, taking the adjusted image to be displayed as the target image,determining the display direction and the imaging distance according tothe real-time image and an environmental scene image pre-stored in theimage processing device 200, and sending the target image, the displaydirection, and the imaging distance to the AR glasses 100, wherein theenvironmental scene image includes an area 300 corresponding to thevirtual display area for displaying the target image.

Optionally, the environmental scene image is a pre-scanned image of theenvironmental scene in which the AR glasses 100 are located, so as todetermine the display direction and the imaging distance, determine thevirtual display area 300, and the AR glasses 100 can display the targetimage to the virtual display area 300 according to the display directionand the imaging distance.

Optionally, the target image includes texts.

Optionally, referring to FIG. 1 , the AR glasses 100 and the imageprocessing device 200 are in a wireless communication connection.

The AR glasses 100 of the embodiment of the present disclosure can sendthe real-time image of the current visual field range of the userwearing the AR glasses 100 in the real environment to the imageprocessing device; the image processing device adjusts the image to bedisplayed based on the real-time image, and takes the adjusted image tobe displayed as the target image, so that the target image will beadjusted in real-time according to the change of the real-time image ofthe visual field range of the user wearing the AR glasses in the realenvironment, so as to adapt to the environmental scene of the real worldwhere the AR glasses 100 are located in real time, and be organicallyfused with the real-time image of the environmental scene of the realworld; and thus, the user can always obtain an immersive experience andit improves the user experience.

Optionally, the AR glasses 100 can be used as a teleprompter tofacilitate the display of prompt information (e.g., the text) to theuser wearing the AR glasses 100. The text can be included in the targetimage displayed on the virtual display area 300. The target image can beseen in the case where the view field of the user wearing the AR glasses100 includes the virtual display area 300.

Optionally, the image processing device 200 can be a cell phone, amobile box or server or the like capable of implementing the imageprocessing method of the embodiments of the present disclosure.

Optionally, the virtual display area 300 can be variable or constant,and the virtual display area 300 is not visible to other people exceptthe user wearing the AR glasses 100, and thus does not exist to otherpeople.

Optionally, referring to FIG. 2 , a principle schematic diagram of theAR glasses 100 displaying the target image to the virtual display area300 is shown, wherein X represents the texts displayed in the targetimage, and a dotted line represents a display boundary for displayingaccording to the display direction and the imaging distance, and thevirtual display area 300 is located in front of the AR glasses 100 atthis time, and within the view field of a user wearing the AR glasses100, and the user can see the texts on the virtual display area 300.

Based on the same invention concept, the embodiment of the presentdisclosure provides the AR glasses 100, referring to FIG. 3 , the ARglasses 100 include a camera circuit 110 and a display circuit 120.

The camera circuit 110, for example, is a camera, and is configured foracquiring the real-time image of the current visual field range of theuser wearing the AR glasses 100 in the real environment, and sending thereal-time image to the image processing device 200, so that the imageprocessing device 200 adjusts the image to be displayed based on thereal-time image, takes the adjusted image to be displayed as the targetimage, and determines the display direction and the imaging distanceaccording to the real-time image and the environmental scene imagepre-stored in the image processing device 200, wherein the environmentalscene image includes the area 300 corresponding to the virtual displayarea for displaying the target image. Specifically, the camera circuit110 can take a picture of the real-time environment in which the currentuser is located.

The display circuit 120 is configured for receiving the target image,the display direction, and the imaging distance sent by the imageprocessing device 200, and displaying the target image to the virtualdisplay area 300 according to the display direction and the imagingdistance.

Optionally, the camera circuit 110 and the display circuit 120 may be ormay not be communicatively connected to each other. Both the cameracircuit 110 and the display circuit 120 are communicatively connected tothe image processing device 200.

Optionally, the camera circuit 110 is configured for scanning theenvironmental scene within the preset range in the real environment toform the environmental scene image and sending the environmental sceneimage to the image processing device. The environmental scene within thepreset range needs to include the virtual display area 300 fordisplaying the target image.

Optionally, scanning the environmental scene within the preset range inthe real environment can be scanning the entire environmental scene inthe real world, and the environmental scene can be a three-dimensionalspace image.

In some embodiments, referring to FIG. 3 , the AR glasses 100 furtherinclude: a light sensing device 130, wherein the light sensing device130 is communicatively connected to the display circuit 120.

The light sensing device 130 is configured for detecting light changesof the environmental scene in the real environment and for sending thelight changes to the display circuit 120.

The display circuit 120 is also configured for adjusting the lenstransmittance of the AR glasses 100 based on the light changes.

Optionally, the display circuit 120 decreases the lens transmittance ofthe AR glasses 100 when the light becomes strong, and increases the lenstransmittance of the AR glasses 100 when the light becomes weak. The ARglasses 100 of the embodiments of the present disclosure allow the userwearing the AR glasses 100 to see the target image more clearly byadjusting the lens transmittance.

Optionally, the AR glasses 100 further include a selection button forselecting a display mode, and options of the selection button include aprojection mode and a spatial mode. The user can select to use theprojection mode or the spatial mode according to the situation of theenvironment scene. Specifically, the display direction of the projectionmode correspondingly changes as the current view field changes and thedisplay direction of the spatial mode is a preset fixed direction.

For example, when the AR glasses 100 use the projection mode, the targetimage including the prompt text always appears in the view field of theAR glasses 100, is displayed in front of the user's eyes, and movesfollowing the changes of the user's head posture.

For another example, when the AR glasses 100 use the spatial mode, theAR glasses 100 scan the environmental scene in the preset range inadvance, and then fix the reminding content as the virtual object at thecertain specific position in space, wherein the certain specificposition is the position of the virtual display area 300 correspondinglydetermined according to the designed display direction and the imagingdistance; and when the head posture changes, a person's sight line canleave the reminding content of the target image.

The AR glasses 100 of the embodiments of the present disclosure canselect different display modes according to different use scenarios, andthe two modes can be easily switched, thereby giving the user a betterexperience in different application scenarios.

Compared with the teleprompter in the related art, the teleprompterusing the AR glasses 100 of the embodiments of the present disclosurepresents the target image display including the words directly in frontof the user, the user can move freely, and the target image can alwaysbe in front of the user's eyes to remind the user of words; or thetarget image is fixed at the specific direction, and when the user needsto watch the words, the words can be seen by user turning the head tothe specific direction, which is convenient to use.

Meanwhile, in the embodiments of the present disclosure, theteleprompter using the AR glasses 100 uses a split-type design toseparate the AR glasses 100 from the image processing device 200, i.e.,the hardware for processing and the hardware for displaying areseparated from each other, that is, the image processing and theformation of the target image are both implemented by the imageprocessing device 200 and sent back to the AR glasses 100 fordisplaying, so as to reduce the weight of the glasses to be easily wornby the user.

Embodiments of the present disclosure can select the different displaymodes according to the different environmental scenarios.

For example, for being used in a lecture in an exhibition hall, thetexts preferably always move along with the speaker (i.e. the user), andthe projection mode of the AR glasses 100 can be used to ensure that thepicture is always in front of the human eyes. Since the current viewfield of the AR glasses 100 is constantly changing, the target image ofthe AR glasses 100 can also constantly adjust the position of thevirtual display area according to the user's view field.

For example, in a lecture in an auditorium, the spatial mode of the ARglasses 100 can be used because the surrounding environmental scene isfixed. Taking the reminding content of the AR glasses 100 as a part ofthe space, like a blackboard or a poster, the virtual display area isfixed at a specific position in the space, and the display style of thetarget image of the AR glasses 100 changes when the environment aroundthe virtual display area changes.

Based on the same inventive concept, the embodiment of the presentdisclosure provides a display method of the AR glasses 100, which isperformed by the AR glasses 100, referring to FIG. 4 , the displaymethod of the AR glasses 100 includes steps S401 to S403.

In step S401, the real-time image of the current view field range of auser wearing the AR glasses 100 in the real environment is acquired.

Optionally, the AR glasses 100 acquire the real-time image of thecurrent view field of the user wearing the AR glasses 100 in the realenvironment.

In some embodiments, before acquiring the real-time image of the currentview field of the user wearing the AR glasses 100 in the real-worldenvironment, the display method further includes: when a display modeselection instruction is received, the display mode is determinedaccording to the display mode selection instruction; the display modesinclude at least one of the projection mode and the space mode, and thedisplay direction of the projection mode correspondingly changes withthe current visual field range; and the display direction of the spatialmode is the preset fixed direction.

The display mode is sent to the image processing device 200.

Optionally, the AR glasses 100 include the selection button forselecting the display mode, and the display mode selection instructionis sent by the user manually selecting the selection button of thedisplay mode.

In some embodiments, before acquiring the real-time image of the currentview field range of the user wearing the AR glasses 100 in thereal-world environment, the display method further includes: theenvironmental scene within the preset range in the real environment isscanned to form the environmental scene image; the environmental sceneimage is sent to the image processing device 200.

In step S402, the real-time image is sent to the image processing device200, so that the image processing device 200 adjusts the image to bedisplayed based on the real-time image, the adjusted image to bedisplayed is taken as a target image, a display direction and an imagingdistance are determined according to the real-time image and theenvironmental scene image pre-stored in the image processing device 200,and the target image, the display direction, and the imaging distanceare sent to the AR glasses 100, wherein the environmental scene imageincludes the area 300 corresponding to the virtual display area fordisplaying the target image.

Optionally, the AR glasses 100 transmit the real-time image to the imageprocessing device 200, so that the image processing device 200 adjuststhe image to be displayed based on the real-time image, takes theadjusted image to be displayed as the target image, determines thedisplay direction and the imaging distance according to the real-timeimage and the environmental scene image pre-stored in the imageprocessing device 200, and transmits the target image, the displaydirection, and the imaging distance to the AR glasses 100, wherein theenvironmental scene image includes the area 300 corresponding to thevirtual display area for displaying the target image.

In step S403, the target image, the display direction, and the imagingdistance sent by the image processing device 200 are received, and thetarget image is displayed to the virtual display area 300 according tothe display direction and the imaging distance.

Optionally, the AR glasses 100 receive the object image, the displaydirection, and the imaging distance sent from the image processingdevice 200, and displays the object image to the virtual display area300 according to the display direction and the imaging distance.

In some embodiments, the displaying method of the AR glasses 100 furtherincludes: the light changes of the environmental scene in the realenvironment are detected; the transmittance of the lens of the ARglasses 100 is adjusted according to the light changes.

Optionally, the AR glasses 100 includes the light sensing device 130,which is configured for detecting light changes of the environmentalscene in the real-world environment; the transmittance of the lens ofthe AR glasses 100 is adjusted according to the light changes.

Based on the same invention concept, the embodiment of the presentdisclosure provides the image processing method to be executed by theimage processing device 200, which includes steps S501 to S504,referring to FIG. 5 .

In step S501, a real-time image of a current view field of a userwearing the AR glasses 100 in a real environment sent by the AR glasses100 is received.

Optionally, the image processing device 200 receives the real-time imageof the current view field range of the user wearing the AR glasses 100in the real environment sent by the AR glasses 100.

In step S502, the image to be displayed is adjusted based on thereal-time image, and the adjusted image to be displayed is taken as thetarget image.

Optionally, the image processing device 200 adjusts the image to bedisplayed based on the real-time image, the adjusted image to bedisplayed is taken as the target image.

In some embodiments, the image to be displayed is adjusted based on thereal-time image, further includes: color analysis is performed on thereal-time image to obtain the color of the real-time image; whether thedifference between the color of the text in the image to be displayedand the color of the real-time image is less than a preset value isdetermined; if the difference between the color of the text in the imageto be displayed and the color of the real-time image is less than thepreset value, adjusting the color of the text in the image to bedisplayed so that the difference between the color of the text in theimage to be displayed and the color of the real-time image is not lessthan the preset value; if the difference between the color of the textsin the image to be displayed and the color of the real-time image is notless than a preset value, the color of the texts in the image to bedisplayed is kept unchanged.

Optionally, the display difference between the color of the texts in theimage to be displayed and the color of the real-time image is greaterthan the preset value, so as to ensure that the color of the texts inthe target image is different from or not similar to the color of thearea corresponding to the real-time image of the current visual fieldrange of the AR glasses 100, so as to facilitate the user to see thecontent displayed in the target image.

In some embodiments, the image to be displayed is adjusted based on thereal-time image, further includes: whether there is the image of theperson in the real-time image is detected;

if there is the image of the person, the display style of the texts inthe image to be displayed is adjusted so as to separate the texts in theimage to be displayed from the image of the person; and the displaystyle includes at least one of the following: the display area, thedisplay size, and the display quantity.

In some embodiments, the image to be displayed is adjusted based on thereal-time image, further includes: whether the real-time image has thefixed blocking object image is detected; the fixed blocking object imagecorresponds to a fixed blocking object under the environmental scene inthe real environment; when there is the fixed blocking object image inthe real-time image, the display style of the texts in the image to bedisplayed is adjusted so that the texts in the image to be displayed areseparated from the fixed blocking object image; the display styleincludes at least one of: the display area, the display size, and thedisplay quantity; and/or, the display direction and the imaging distanceare determined according to the real-time image and the environmentalscene image pre-stored in the image processing device 200, whichincludes: whether the real-time image has the fixed blocking objectimage is detected, wherein the fixed blocking object image correspondsto the fixed blocking object under the environmental scene in the realenvironment; when there is the fixed blocking object image in thereal-time image, the imaging distance to be adjusted of the text in theimage to be displayed is adjusted, and the adjusted imaging distance istaken as the imaging distance, so that the texts in the image to bedisplayed are separated from the fixed blocking object image.

In step S503, the display direction and the imaging distance aredetermined based on the real-time image and the environmental sceneimage pre-stored in the image processing device 200.

Optionally, the image processing device 200 determines the displaydirection and the imaging distance according to the real-time image andthe environmental scene image pre-stored in the image processing device200.

In some embodiments, in step S401, before the real-time image of thecurrent view field range of the user wearing the AR glasses 100 in thereal environment sent by the AR glasses 100 is received, the methodfurther includes: the display mode sent by the AR glasses 100 isreceived; the display direction and the imaging distance are determinedaccording to the real-time image and the environmental scene imagepre-stored in the image processing device 200, which includes: if it isdetermined that the display mode is the projection mode, the directionrange of the current visual field of the AR glasses 100 is determinedaccording to the real-time image and the pre-stored environmental sceneimage, and the preset direction in the direction range of the currentvisual field is taken as the display direction.

If it is determined that the display mode is the spatial mode, thepreset fixed direction corresponding to the pre-stored environmentalscene image is taken as the display direction.

Optionally, in step S401, before the real-time image of the current viewfield range of the user wearing the AR glasses 100 in the realenvironment sent by the AR glasses 100 is received, the method furtherincludes: the display mode corresponding to the environmental scene isidentified according to the pre-stored environmental scene image so asto determine the display mode, wherein the display mode includes atleast one of the following: the projection mode and the spatial mode.That is, the image processing device 200 can select the display modeaccording to the environmental scene, without requiring the user to setthe display mode through the AR glasses 100.

The projection mode of the embodiment of the present disclosure cancorrespondingly adjust the display direction according to the change ofthe current view field of the AR glasses 100, so that the position ofthe target image can be adjusted according to the head postures of theuser wearing the AR glasses, and the target image can also be seen bythe user when the user wearing the AR glasses rotates their head.

In step S504, the target image, the display direction, and the imagingdistance are sent to the AR glasses 100.

Optionally, the image processing device 200 transmits the object image,the display direction, and the imaging distance to the AR glasses 100.

Based on the above-mentioned technical solution, the embodiment of thepresent disclosure provides the image processing method, which isapplied to the image processing device 200, referring to FIG. 6 , theimage processing method includes the following steps.

In step S601, the real-time image of the current view field range of theuser wearing the AR glasses 100 in a real environment sent from the ARglasses 100 is received, and then steps S602, S604, S606, and S609 areperformed.

In step S602, whether the display difference between the color of thetext in the image to be displayed and the color of the real-time imageis less than the preset value is determined; if it is, step S603 isperformed, and if it is not, the process ends.

Optionally, before the step S602, color analysis is performed on thereal-time image to obtain the color of the real-time image.

Optionally, the display difference between the color of the texts in theimage to be displayed and the color of the real-time image is greaterthan the preset value, so as to ensure that the color of the texts inthe target image is different from or not similar to the color of thearea corresponding to the real-time image of the current visual fieldrange of the AR glasses 100, so as to facilitate the user to see thecontent displayed in the target image.

In step S603, the color of the text in the image to be displayed isadjusted so that the display difference between the color of the text inthe image to be displayed and the color of the real-time image is notless than a preset value, and then step S608 is executed.

In step S604, it is determined whether or not there is the image of theperson in the real-time image, and if it is, step S605 is executed, andif it is not, the process ends.

In step S605, the display style of the texts in the image to bedisplayed is adjusted so as to separate the texts in the image to bedisplayed from the image of the person; and the display style includesat least one of the following: the display area, the display size, andthe display quantity, then step S608 is executed.

Optionally, the image of the person includes at least part of a body ofthe person, such as a head or a limb. The inventor of the presentdisclosure considers that when there is the image of the person in thereal-time image, the image of the person at least partially coincideswith the texts in the target image, the display effect of the texts inthe target image are affected, and therefore it is necessary to adjustthe display style of the texts in the image to be displayed, so that thetexts in the image to be displayed are separated from the image of theperson, thereby separating the texts in the target image of the virtualdisplay area 300 from the person in the environmental scene in realtime.

The inventors of the present disclosure considers that the persongenerally moves and occupies only a small area in the image, and thedisplay quality can be improved by selecting a mode of adjusting thedisplay style so that the texts in the image to be displayed areseparated from the image of the person.

Optionally, if there is the image of the person in the real-time image,the imaging distance of the texts in the image to be displayed isadjusted, so that the position of the virtual display area 300 changesto achieve that the texts displayed by the AR glasses 100 in the targetimage of the virtual display area 300 are separated from the person inthe environmental scene.

In step S606, whether the fixed blocking object image exists in thereal-time image or not is determined, if so, step S607 is executed, andif not, the process ends.

In step S607, the display style of the texts in the image to bedisplayed is adjusted so that the texts in the image to be displayed areseparated from the fixed blocking object image; the display styleincludes at least one of: the display area, the display size, and thedisplay quantity.

Optionally, the imaging distance to be modified is the imaging distanceat the previous moment, and the adjusted imaging distance to be modifiedis taken as the imaging distance and is the imaging distancecorresponding to the adjusted image to be displayed.

Optionally, the fixed blocking object includes, e.g., a wall or a post,and the inventor of the present disclosure considers that when the fixedblocking object image exists in the real-time image, the fixed blockingobject image at least partially overlaps with the texts in the targetimage, the display effect of the text in the target image is affected,and therefore it is necessary to adjust the display style of the textsin the image to be displayed, so that the texts in the image to bedisplayed are separated from the fixed blocking object, and the texts inthe target image displayed by the AR glasses 100 in the virtual displayarea 300 are separated from the fixed blocking object in theenvironmental scene.

Optionally, the step of detecting whether there is the fixed blockingobject image in the real-time image is primarily used in the projectionmode, since the virtual display area 300 in the spatial mode is presetand will be considered to avoid the fixed blocking object. Therefore,when the display mode is the spatial mode, it is mainly detected whetherthere is the image of the person in the real-time image.

Optionally, the image processing device 200 pre-stores the environmentalscene image, and can simulate displaying the image to be displayed inthe area corresponding to the virtual display area 300 in theenvironmental scene image, and according to the image of the person orthe fixed blocking object image in the real-time image, the displaystyle and/or the imaging distance of texts in the image to be displayedare adjusted so that the texts displayed by the AR glasses 100 in thetarget image of the virtual display area 300 are separated from theperson or the fixed blocking object in the environmental scene.

It is conceivable that the target image may also include promptinformation such as graphics, and the principle of adjusting thegraphics in the image to be displayed is the same as the principle ofadjusting the text in the image to be displayed.

In step S608, the adjusted image to be displayed is taken as the targetimage.

In step S609, the display direction and the imaging distance aredetermined according to the real-time image and the pre-storedenvironmental scene image, and the process goes to step S610.

Optionally, in step S609, according to the real-time image and thepre-stored environmental scene image, the display direction and theimaging distance are determined, which includes: if it is determinedthat the display mode is the projection mode, the direction range of thecurrent visual field of the user wearing the AR glasses 100 in the realtime environment is determined according to the real-time image and thepre-stored environmental scene image, and the preset direction in thedirection range of the current visual field is taken as the displaydirection; if it is determined that the display mode is the spatialmode, the preset fixed direction corresponding to the pre-storedenvironmental scene image is taken as the display direction.

Optionally, the preset direction in the range of directions of thecurrent view field is directly in front of the current view field.

Optionally, the preset fixed direction corresponding to the pre-storedenvironmental scene image is taken as the display direction, whichincludes: the environmental scene image is displayed on the displayinterface of the image processing device 200; the confirmation selectionbox instruction is received, and the area corresponding to the virtualdisplay area 300 in the environmental scene image is determinedaccording to the area selected by the selection box determined by theconfirmation selection box instruction;

According to the area in the environmental scene image corresponding tothe virtual display area 300, the preset fixed direction correspondingto the environmental scene image is determined and stored as the displaydirection.

Optionally, the person autonomously selects an appropriate position asthe virtual display area 300 in the environmental scene through theselection box corresponding to the virtual display area 300 on thedisplay interface of the image processing device 200.

Optionally, the preset fixing direction may be directly in front of theglasses-wearing user facing the auditorium, i.e. directly in front of anexhibition hall or an academic hall, or the appropriate position can beselected according to empirical data, like a blackboard or a poster,fixed at a certain position in the space of the environmental scene.

Optionally, the preset fixed direction corresponding to the pre-storedenvironmental scene images can be at least one, namely, one, two or morepreset fixed directions can be selected, which is equivalent to realizethat a plurality of virtual display areas 300 that can display thetarget image, so that the user can select to view the target image in anearby manner. Specifically, when the display mode is the spatial mode,the appropriate preset fixed direction and imaging distance are selectedaccording to the pre-stored environmental scene image, thereby selectingthe appropriate virtual display area 300.

In step S610, whether the fixed blocking object image exists in thereal-time image or not is determined, if so, step S611 is executed, andif not, the process ends.

In step S611, the imaging distance of the text in the image to bedisplayed is adjusted, and the adjusted imaging distance is taken as theimaging distance, so that the texts in the image to be displayed areseparated from the fixed blocking object image, and the process goes tostep S609.

S612, the target image, the display direction, and the imaging distanceare sent to the AR glasses 100. The target image, the display direction,and the imaging distance are obtained in step S608 and step S609,respectively.

Based on the same invention concept, the embodiment of the presentdisclosure provides the display device of the AR glasses 100, referringto FIG. 7 , the display apparatus 700 of the AR glasses 100 includes: anacquisition circuit 710, a first transmission circuit 720, and a displaycircuit 730. The acquisition circuit 710 is configured for acquiring thereal-time image of the current view field of the user wearing the ARglasses 100 in the real-time environment; the first sending circuit 720is configured for sending the real-time image to the image processingdevice 200, so that the image processing device 200 adjusts the image tobe displayed based on the real-time image, takes the adjusted image tobe displayed as a target image, determines a display direction and animaging distance according to the real-time image and an environmentalscene image pre-stored in the image processing device 200, and sends thetarget image, the display direction and the imaging distance to the ARglasses 100, wherein the environmental scene image includes the area 300corresponding to the virtual display area for displaying the targetimage.

The display circuit 730 is configured for receiving the target image,the display direction, and the imaging distance sent by the imageprocessing device 200, and displaying the target image to the virtualdisplay area 300 according to the display direction and the imagingdistance.

Optionally, the acquisition circuit 710 is further configured forscanning the environmental scene within the preset range in the realenvironment to form the environmental scene image and sending theenvironmental scene image to the image processing device 200.

Optionally, the display circuit 730 is configured for determining thedisplay mode according to the display mode selection instruction whenreceiving the display mode selection instruction; display modes includeat least one of the projection mode and the space mode, and the displaydirection of the projection mode correspondingly changes with thecurrent visual field range; and the display direction of the spatialmode is the preset fixed direction.

Optionally, the first sending circuit 720 is configured for sending thedisplay mode to the image processing device 200.

Optionally, referring to FIG. 7 , the display device 700 of the ARglasses 100 further includes: a photosensitive circuit 740.

The photosensitive circuit 740 is configured for detecting the lightchanges in the environmental scene in the real-world environment.

The display circuit 730 is configured for adjusting the transmittance ofthe lenses of the AR glasses 100 according to the light changes.

Based on the same invention concept, the embodiment of the presentdisclosure provides the image processing device 800, referring to FIG. 8, the image processing device 800 includes: a receiving circuit 810, afirst processing circuit 820, a second processing circuit 830, and asecond sending circuit 840. The receiving circuit 810 is configured forreceiving the real-time image of the current visual field range of theuser wearing the AR glasses 100 in the real environment sent by the ARglasses 100; the first processing circuit 820 is configured foradjusting the image to be displayed based on the real-time image, andtaking the adjusted image to be displayed as a target image; the secondprocessing circuit 830 is configured for determining the displaydirection and the imaging distance according to the real-time image andthe environmental scene image pre-stored in the image processing device200; and the second sending circuit 840 is configured for sending theobject image, the display direction, and the imaging distance to the ARglasses 100.

Optionally, the first processing circuit 820 is configured forperforming color analysis on the real-time image to obtain the color ofthe real-time image, determining whether the display difference betweenthe color of the text in the image to be displayed and the color of thereal-time image is less than the preset value; if the display differencebetween the color of the text in the image to be displayed and the colorof the real-time image is less than the preset value, adjusting thecolor of the text in the image to be displayed so that the displaydifference between the color of the text in the image to be displayedand the color of the real-time image is not less than the preset value.

Optionally, the first processing circuit 820 is configured for detectingwhether there is the image of the person in the real-time image; ifthere is the image of the person, the display style of the texts in theimage to be displayed is adjusted so as to separate the texts in theimage to be displayed from the image of the person; and the displaystyle includes at least one of the following: the display area, thedisplay size, and the display quantity.

Optionally, the first processing circuit 820 is configured for detectingwhether the real-time image has the fixed blocking object image; thefixed blocking object image corresponds to the fixed blocking object inan environmental scene in the real environment; when there is the fixedblocking object image in the real-time image, the display style of thetexts in the image to be displayed is adjusted so that the texts in theimage to be displayed are separated from the fixed blocking objectimage; the display style includes at least one of: the display area, thedisplay size, and the display quantity.

Optionally, the second processing circuit 830 is configured fordetecting whether the real-time image has the fixed blocking objectimage; the fixed blocking object image corresponds to the fixed blockingobject in the environmental scene in the real environment; when there isthe fixed blocking object image in the real-time image, then the imagingdistance of the text in the image to be displayed is adjusted, and theadjusted imaging distance is taken as the imaging distance, so that thetexts in the image to be displayed are separated from the fixed blockingobject image.

Optionally, the receiving circuit 810 is configured for receiving thedisplay mode sent by the AR glasses 100.

Optionally, the second processing circuit 830 is configured for, if itis determined that the display mode is the projection mode, determiningthe direction range of the current visual field of the AR glasses 100according to the real-time image and the environmental scene imagepre-stored in the image processing device 200, and taking the presetdirection in the direction range of the current visual field as thedisplay direction; wherein if it is determined that the display mode isthe spatial mode, the preset fixed direction corresponding to thepre-stored environmental scene image is taken as the display direction.

Based on the same invention concept, the embodiment of the presentdisclosure provides the image processing device 200, including: aprocessor, a memory electrically connected to the processor; and atleast one program stored in the memory and configured to be executed bythe processor, wherein the at least one program is configured forimplementing the image processing method according to any one of theembodiments of the present disclosure.

It should be understood that those skilled in the art that the imageprocessing device 200 provided by the embodiments of the presentdisclosure can be specially designed and manufactured for the requiredpurposes, or can include known device in a general purpose computer. Thedevice has computer programs stored and the computer programs areselectively activated or reconfigured. Such computer programs can bestored in a device (e. g. a computer) readable medium or any type ofmedium which is suitable for storing electronic instructions and eachcoupled to a bus.

The present disclosure provides, in an optional embodiment, anelectronic device, as shown in FIG. 9 , the image processing device 200includes: a processor 2001 and a memory 2003, wherein the processor 2001is communicatively connected to the memory 2003, such as via a bus 2002.

The processor 2001 can be a CPU (Central Processing Unit), a generalpurpose processor, a DSP (Digital Signal Processor), an ASIC(Application Specific Integrated Circuit), an FPGA (Field-ProgrammableGate Array) or other programmable logic device, a transistor logicdevice, a hardware component, or any combination thereof. Variousillustrative logical blocks, modules, and circuits described inconnection with the present disclosure can be implemented or performed.The processor 2001 can also be a combination that performs computingfunctions, including, for example, a combination of one or moremicroprocessors, a combination of a DSP and a microprocessor, etc.

The bus 2002 can include a path to transfer information between thecomponents described above. The bus 2002 can be a PCI (PeripheralComponent Interconnect) bus or an EISA (Extended Industry StandardArchitecture) bus or the like. The bus 2002 can be divided into anaddress bus, a data bus, a control bus, etc. For ease of illustration,only one bold line is shown in FIG. 9 , but does not indicate that thereis only one bus or one type of bus.

The memory 2003 can be, but is not limited to, a ROM (Read-Only Memory)or other type of static storage device that can store static informationand instructions, a RAM (Random Access Memory), or other types ofdynamic storage devices that can store information and instructions, orcan also be EEPROM (Electrically Erasable Programmable Read OnlyMemory), CD-ROM (Compact Disc Read Only Memory), or other optical discstorage, the optical disc storage (including a compact disc, a laserdisc, an optical disc, a digital universal disc, a blue-ray disc and thelike), a disk storage medium or other magnetic storage device, or anyother medium configurable to contain or store an expected program codein an instruction or data structure form and accessible for a computer.

Optionally, the image processing device 200 can further include atransceiver 2004, wherein the transceiver 2004 can be configured forreceiving and sending signals; the transceiver 2004 can allow the imageprocessing device 200 to communicate in a wireless or wired manner withother devices to exchange data. It should be noted that the transceiver2004 is not limited to one in practice.

Optionally, the image processing device 200 can further include an inputunit 2005, wherein the input unit 2005 can be configured for receivinginput numbers, characters, images and/or sound information, orgenerating key signal inputs related to user settings and functioncontrols of the image processing device 200; the input unit 2005 caninclude, but is not limited to, one or more of a touch screen, aphysical keyboard, function keys (such as volume control keys, switchkeys, etc.), a trackball, a mouse, a joystick, a camera, a microphone,etc.

Optionally, the image processing device 200 can further include anoutput unit 2006, wherein the output unit 2006 can be configured foroutputting or presenting information processed by the processor 2001;the output unit 2006 can include, but is not limited to, one or more ofa display device, a speaker, a vibration device, etc.

Although FIG. 9 illustrates the image processing device 200 havingvarious devices, it should be understood that not all of the illustrateddevices are required to be implemented or provided. More or fewerdevices can alternatively be implemented or provided.

Optionally, the memory 2003 is configured for storing application codefor executing the disclosed solutions and the execution is controlled bythe processor 2001. The processor 2001 is configured for executing theapplication code stored in the memory 2003 to implement any of the imageprocessing methods provided by embodiments of the present disclosure.

Based on the same invention concept, the embodiments of the presentdisclosure provide the computer-readable storage medium for storingcomputer instructions that, when executed on the computer, implement thedisplay method of the AR glasses 100 of any embodiment of the presentdisclosure or the image processing method of any embodiment of thepresent disclosure.

The computer readable storage medium includes, but is not limited to,any type of disk (including floppy disks, hard disks, optical disks,CD-ROMs, and magneto-optical disks), ROMs, RAMs, EPROMs (ErasableProgrammable Read-Only Memories), EEPROM, flash memory, magnetic oroptical cards. That is, the readable medium includes any medium that canbe read by device (e.g. a computer) to store or transmit information.

With the embodiments of the present disclosure, at least the followingadvantageous effects can be achieved.

(1) By using the embodiments of the present disclosure, the target imagecan be modified in real time according to the change of theenvironmental scene, so as to adapt to the environmental scene in thereal environment where the AR glasses are located in real time, and beorganically fused with the real-time image of the environmental scene inthe real environment, so as to ensure that the user can always obtain animmersive use experience, thereby improving the user experience.

(2) The AR glasses 100 of the embodiments of the present disclosure canselect different display modes including the projection mode and thespatial mode according to different use scenarios, and the two modes canbe easily switched, thereby giving the user a better experience indifferent application scenarios.

(3) The AR glasses 100 of the embodiment of the present disclosure canbe used as the teleprompter to present the target image displayincluding the word extraction directly in front of the user, the usercan move freely, and the target image can always be in front of the userto remind the user of words; or the target image is fixed at thespecific orientation, and when the user needs to watch the remindingwords, the reminding words can be seen by the user by turning the headto the specific orientation, which is convenient to use.

(4) The embodiment of the present disclosure adopts the split-typedesign of the display system of the AR glasses 100, and separates the ARglasses 100 from the image processing device 200, two parts hardware ofprocessing and displaying are separated, that is, and the imageprocessing and the formation of the target image are both completed bythe image processing device 200 and sent back to the AR glasses 100 fordisplay, so as to reduce the weight of the glasses to be easily worn bythe user.

(5) The embodiments of the present disclosure can adjust the displayarea, display size or display quantity of the texts of the image to bedisplayed according to the real-time image, and at the same time canalso adjust the imaging distance of the image to be displayed, so thatthe texts in the image to be displayed are separated from the image ofthe person and/or the fixed blocking object, thereby separating the textin the target image of the virtual display area 300 from the personand/or the fixed blocking object in the environmental scene in realtime, ensuring clear display of the target image.

Those skilled in the art will understand that the AR glasses 100described above can also be replaced with other types of AR wearabledevices, such as the AR helmets.

Those skilled in the art should understand that the various operations,methods, steps, acts, schemes, etc. discussed in the present disclosuremay be alternated, altered, combined, or deleted. Further, operations,methods, other steps, acts, and schemes in the various operations,methods, and schemes discussed in the present disclosure may bealternated, altered, rearranged, decomposed, combined, or deleted.Further, various operations, methods, steps, acts, and schemes disclosedin the prior art may also be alternated, altered, rearranged,decomposed, combined, or deleted.

In the description of the present disclosure, it should be understoodthat the orientation or positional relationship indicated by the terms“center”, “upper”, “lower”, “front”, “rear”, “left”, “right”,“vertical”, “horizontal”, “top”, “bottom”, “inner”, “outer”, and thelike is based on the orientation or positional relationship shown in thedrawings, and is merely for convenience of describing the disclosure andsimplifying the description, but not intended or implied that thereferenced device or element must have a particular orientation, beconstructed and operated in a particular orientation, and thus shouldnot be construed as limiting the present disclosure.

The terms “first” and “second” are configured for descriptive purposesonly and are not to be construed as indicating or implying relativeimportance or implicitly indicating the number of technical featuresindicated. Therefore, a feature defined by “first” and “second” mayexplicitly or implicitly indicate inclusion of one or more suchfeatures. In the description of the present disclosure, the meaning of“a plurality of” is two or more unless otherwise specified.

In the description of the present disclosure, it should be noted thatthe terms “mount”, “connect” and “connected” are to be construedbroadly, e.g. may be fixedly connected, removably connected, orintegrally connected, may be a direct connection or an indirectconnection through an intermediate medium, or a communication betweentwo elements, unless explicitly stated or defined. The specific meaningsof the above terms in the present disclosure will be understood on acase-by-case basis by those of ordinary skill in the art.

In the description of the present disclosure, particular features,structures, materials, or characteristics can be combined in anysuitable manner in any one or more embodiments or examples.

It should be understood that, although the various steps in theflowcharts of the drawings are shown in order as indicated by thearrows, the steps are not necessarily performed in the order indicatedby the arrows. The steps are performed in no strict order unlessexplicitly stated herein, and may be performed in other orders.Furthermore, at least some of the steps in the flowcharts of thedrawings may include a plurality of sub-steps or a plurality of stages,which are not necessarily performed at the same time, but may beperformed at different times, in a different order, and may be performedin turn or in alternation with at least some of the other steps orsub-steps or stages of other steps.

While the foregoing is only part of embodiments of the presentdisclosure, it should be understood by those skilled in the art thatvarious improvements and modifications may be made without departingfrom the principle of the present disclosure, and theses improvement andmodifications shall fall within the scope of protection of the presentdisclosure.

What is claimed is:
 1. An image processing and displaying methodoperable by a display system, wherein the display system comprises anAugmented Reality (AR) device and an image processing device, and theimage processing and displaying method comprises: acquiring, by the ARdevice, a real-time image of a current view field of a user wearing theAR device in a real environment; sending, by the AR device, thereal-time image to the image processing device; receiving, by the ARdevice, a display direction, an imaging distance, and a target imagesent by the image processing device, and displaying, by the AR device,the target image in a virtual display area according to the displaydirection and the imaging distance, wherein the image processing anddisplaying method further comprises: after sending, by the AR device,the real-time image to the image processing device, receiving, by theimage processing device, the real-time image sent by the AR device;adjusting, by the image processing device, an image to be displayedbased on the real-time image, and taking, by the image processingdevice, the adjusted image to be displayed as the target image;determining, by the image processing device, the display direction andthe imaging distance according to the real-time image and a pre-storedenvironmental scene image; and sending the target image, the displaydirection, and the imaging distance to the AR device, wherein theenvironmental scene image comprises an area corresponding to a virtualdisplay area configured for displaying the target image, wherein theadjusting, by the image processing device, the image to be displayedbased on the real-time image, comprises: performing color analysis onthe real-time image to obtain a color of the real-time image;determining whether a display difference between a color of a text inthe image to be displayed and the color of the real-time image is lessthan a preset value; when the display difference between the color ofthe text in the image to be displayed and the color of the real-timeimage is less than the preset value, adjusting the color of the text inthe image to be displayed, to enable the display difference between thecolor of the text in the image to be displayed and the color of thereal-time image to be not less than the preset value.
 2. The imageprocessing and displaying method according to claim 1, furthercomprising: before acquiring, by the AR device, the real-time image ofthe current view field of the user wearing the AR device in the realenvironment, receiving a display mode selection instruction; determininga display mode according to the display mode selection instruction,wherein the display mode comprises a projection mode and a spatial mode;in the display mode, the display direction correspondingly changes asthe current view field changes; in the spatial mode, the displaydirection is a preset fixed direction; and sending the display mode tothe image processing device.
 3. The image processing and displayingmethod according to claim 1, further comprising: before acquiring, bythe AR device, the real-time image of the current view field of the userwearing the AR device in the real environment, scanning an environmentalscene within a preset range in the real environment to form anenvironmental scene image; sending the environmental scene image to theimage processing device.
 4. The image processing and displaying methodaccording to claim 1, further comprising: detecting a light change ofthe environmental scene in the real environment; adjusting atransmittance of a lens of the AR device according to the light change.5. The image processing and displaying method according to claim 1,further comprising: before receiving, by the image processing device,the real-time image sent by the AR device, receiving the display modesent by the AR device; the determining the display direction and theimaging distance according to the real-time image and the pre-storedenvironmental scene image comprises: when determining that the displaymode is the projection mode, determining a direction range of thecurrent visual field of the user wearing the AR device according to thereal-time image and the pre-stored environmental scene image, and takinga preset direction in the direction range of the current visual field asthe display direction; and when determining that the display mode is thespatial mode, taking the preset fixed direction corresponding to thepre-stored environmental scene image as the display direction.
 6. Theimage processing and displaying method according to claim 1, wherein theAR device is AR glasses or an AR helmet.
 7. A display system,comprising: a processor, a memory electrically connected to theprocessor; at least one program stored in the memory and configured forbeing executed by the processor, wherein the at least one program isconfigured for implementing the image processing and displaying methodaccording to claim
 1. 8. The display system according to claim 7,wherein the at least one program is further configured for: beforeacquiring the real-time image of the current view field of the userwearing the AR device in the real environment, receiving a display modeselection instruction; determining a display mode according to thedisplay mode selection instruction, wherein the display mode comprises aprojection mode and a spatial mode; in the display mode, the displaydirection correspondingly changes as the current view field changes; inthe spatial mode, the display direction is a preset fixed direction; andsending the display mode to the image processing device.
 9. The displaysystem according to claim 7, wherein the at least one program is furtherconfigured for: before acquiring the real-time image of the current viewfield of the user wearing the AR device in the real environment,scanning an environmental scene within a preset range in the realenvironment to form an environmental scene image; sending theenvironmental scene image to the image processing device.
 10. Thedisplay system according to claim 7, wherein the at least one program isfurther configured for: detecting a light change of the environmentalscene in the real environment; adjusting a transmittance of a lens ofthe AR device according to the light change.
 11. A non-transitorycomputer-readable storage medium, wherein the computer-readable storagemedium is configured for storing a computer instruction which, whenexecuted on a computer, implement the image processing and displayingmethod according to claim
 1. 12. An image processing and displayingmethod operable by a display system, wherein the display systemcomprises an AR device and an image processing device, and the imageprocessing and displaying method comprises: acquiring, by the AR device,a real-time image of a current view field of a user wearing the ARdevice in a real environment; sending, by the AR device, the real-timeimage to the image processing device; receiving, by the AR device, adisplay direction, an imaging distance, and a target image sent by theimage processing device, and displaying, by the AR device, the targetimage in a virtual display area according to the display direction andthe imaging distance, wherein the image processing and displaying methodfurther comprises: after sending, by the AR device, the real-time imageto the image processing device, receiving, by the image processingdevice, the real-time image sent by the AR device; adjusting, by theimage processing device, an image to be displayed based on the real-timeimage, and taking, by the image processing device, the adjusted image tobe displayed as the target image; determining, by the image processingdevice, the display direction and the imaging distance according to thereal-time image and a pre-stored environmental scene image; and sendingthe target image, the display direction, and the imaging distance to theAR device, wherein the environmental scene image comprises an areacorresponding to a virtual display area configured for displaying thetarget image, wherein the adjusting, by the image processing device, theimage to be displayed based on the real-time image, comprises: detectingwhether there is an image of a person in the real-time image; when thereis the image of the person in the real-time image, adjusting a displaystyle of the text in the image to be displayed, to enable the text inthe image to be displayed to be separated from the image of the person,wherein the display style comprises at least one of: a display area, adisplay size, and a display quantity.
 13. The image processing anddisplaying method according to claim 12, further comprising: beforeacquiring, by the AR device, the real-time image of the current viewfield of the user wearing the AR device in the real environment,receiving a display mode selection instruction; determining a displaymode according to the display mode selection instruction, wherein thedisplay mode comprises a projection mode and a spatial mode; in thedisplay mode, the display direction correspondingly changes as thecurrent view field changes; in the spatial mode, the display directionis a preset fixed direction; and sending the display mode to the imageprocessing device.
 14. The image processing and displaying methodaccording to claim 12, further comprising: before acquiring, by the ARdevice, the real-time image of the current view field of the userwearing the AR device in the real environment, scanning an environmentalscene within a preset range in the real environment to form anenvironmental scene image; sending the environmental scene image to theimage processing device.
 15. The image processing and displaying methodaccording to claim 12, further comprising: detecting a light change ofthe environmental scene in the real environment; adjusting atransmittance of a lens of the AR device according to the light change.16. The image processing and displaying method according to claim 12,further comprising: before receiving, by the image processing device,the real-time image sent by the AR device, receiving the display modesent by the AR device; the determining the display direction and theimaging distance according to the real-time image and the pre-storedenvironmental scene image comprises: when determining that the displaymode is the projection mode, determining a direction range of thecurrent visual field of the user wearing the AR device according to thereal-time image and the pre-stored environmental scene image, and takinga preset direction in the direction range of the current visual field asthe display direction; and when determining that the display mode is thespatial mode, taking the preset fixed direction corresponding to thepre-stored environmental scene image as the display direction.
 17. Theimage processing and displaying method according to claim 12, whereinthe AR device is AR glasses or an AR helmet.
 18. A display system,comprising: a processor, a memory electrically connected to theprocessor; at least one program stored in the memory and configured forbeing executed by the processor, wherein the at least one program isconfigured for implementing the image processing and displaying methodaccording to claim
 12. 19. The display system according to claim 18,wherein the at least one program is further configured for: beforeacquiring the real-time image of the current view field of the userwearing the AR device in the real environment, receiving a display modeselection instruction; determining a display mode according to thedisplay mode selection instruction, wherein the display mode comprises aprojection mode and a spatial mode; in the display mode, the displaydirection correspondingly changes as the current view field changes; inthe spatial mode, the display direction is a preset fixed direction; andsending the display mode to the image processing device.
 20. An imageprocessing device, comprising: a receiving circuit, configured forreceiving a real-time image of a current view field of a user wearing anAR device in a real environment sent by the AR device; a firstprocessing circuit, configured for adjusting an image to be displayedbased on the real-time image, and taking the adjusted image to bedisplayed as a target image; a second processing circuit, configured fordetermining a display direction and an imaging distance according to thereal-time image and an environmental scene image pre-stored in the imageprocessing device; and a second sending circuit, configured for sendingthe target image, the display direction, and the imaging distance to theAR device, wherein the environmental scene image comprises an areacorresponding to a virtual display area configured for displaying thetarget image, wherein the adjusting the image to be displayed based onthe real-time image comprises: performing color analysis on thereal-time image to obtain a color of the real-time image; determiningwhether a display difference between a color of a text in the image tobe displayed and the color of the real-time image is less than a presetvalue; when the display difference between the color of the text in theimage to be displayed and the color of the real-time image is less thanthe preset value, adjusting the color of the text in the image to bedisplayed, to enable the display difference between the color of thetext in the image to be displayed and the color of the real-time imageto be not less than the preset value.